Sensor having depth sensing pixel and method of using the same

ABSTRACT

A sensor includes a plurality of image sensors, wherein each image sensor of the plurality of image sensors is configured to detect a first spectrum of light. The sensor further includes a depth sensing pixel bonded to each image sensor of the plurality of image sensors, wherein the depth sensing pixel is configured to detect a second spectrum of light different from the first spectrum.

PRIORITY CLAIM

The present application is a continuation of U.S. application Ser. No.15/238,078, filed Aug. 16, 2016, which is a divisional of U.S.application Ser. No. 14/534,892, filed Nov. 6, 2014, now U.S. Pat. No.9,437,633, issued Sep. 6, 2016; which are incorporated herein byreference in their entireties.

BACKGROUND

A depth sensing pixel is used to determine a distance between an imagesensor and an object. An image sensing pixel is used to capture an imageof the object. A composite pixel includes a depth sensing pixel combinedwith an image sensing pixel to determine a distance to the object andcapture an image of the object.

In a structure including both the image sensing pixel and the depthsensing pixel, the outputs of the depth sensing pixel and the imagesensing pixels are output using a time multiplexing strategy, in someapproaches. The time multiplexing strategy allocates one frame to thedepth sensing pixel and one frame to the image sensing pixel in analternating manner.

In approaches where the depth sensing pixel is positioned behind theimage sensing pixel so that incident light passes through the imagesensing pixel to reach the depth sensing pixel, formation of the depthsensing pixel depends on the precision of the fabrication tools. In someapproaches, the depth sensing pixel is located in a non-overlappingposition with the image sensing pixel. In some approaches, the depthsensing pixel is located around a periphery of the image sensing pixel.

BRIEF DESCRIPTION OF THE DRAWINGS

Aspects of the present disclosure are best understood from the followingdetailed description when read with the accompanying figures. It isnoted that, in accordance with the standard practice in the industry,various features are not drawn to scale. In fact, the dimensions of thevarious features may be arbitrarily increased or reduced for clarity ofdiscussion.

FIG. 1 is a schematic diagram of a depth sensing pixel in accordancewith some embodiments.

FIG. 2A is a flowchart of a method of using a depth sensing pixel inaccordance with some embodiments.

FIGS. 2B-2E are diagrams of charge transfer during various stages of themethod in FIG. 2A in accordance with some embodiments.

FIG. 3 is a top view of a layout of a depth sensing pixel in accordancewith some embodiments.

FIG. 4 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 5 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 6 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 7 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 8 is a cross-sectional view of a composite pixel image sensor inaccordance with some embodiments.

FIGS. 9A-9C are views of positional arrangement of a composite pixelimage sensor in accordance with some embodiments.

FIG. 10 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments.

FIG. 11 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments.

FIG. 12 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments.

FIG. 13 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 14 is a schematic diagram of a composite pixel image sensor inaccordance with some embodiments.

FIG. 15 is a flow chart of a method of using a composite pixel imagesensor in accordance with some embodiments.

FIG. 16 is a flow chart of a method of making a composite pixel imagesensor in accordance with some embodiments.

DETAILED DESCRIPTION

The following disclosure provides many different embodiments, orexamples, for implementing different features of the provided subjectmatter. Specific examples of components and arrangements are describedbelow to simplify the present disclosure. These are, of course, merelyexamples and are not intended to be limiting. For example, the formationof a first feature over or on a second feature in the description thatfollows may include embodiments in which the first and second featuresare formed in direct contact, and may also include embodiments in whichadditional features may be formed between the first and second features,such that the first and second features may not be in direct contact. Inaddition, the present disclosure may repeat reference numerals and/orletters in the various examples. This repetition is for the purpose ofsimplicity and clarity and does not in itself dictate a relationshipbetween the various embodiments and/or configurations discussed.

Further, spatially relative terms, such as “beneath,” “below,” “lower,”“above,” “upper” and the like, may be used herein for ease ofdescription to describe one element or feature's relationship to anotherelement(s) or feature(s) as illustrated in the figures. The spatiallyrelative terms are intended to encompass different orientations of thedevice in use or operation in addition to the orientation depicted inthe figures. The apparatus may be otherwise oriented (rotated 90 degreesor at other orientations) and the spatially relative descriptors usedherein may likewise be interpreted accordingly.

FIG. 1 is a schematic diagram of a depth sensing pixel 100 in accordancewith some embodiments. Depth sensing pixel 100 includes a sensingcircuit 110 configured to detect electromagnetic radiation. A readoutcircuit 120 is coupled to sensing circuit 110. Readout circuit 120 isconfigured to transfer a signal from sensing circuit 110 to externalcircuits.

Sensing circuit 110 is configured to detect electromagnetic radiationreflected by an object. In some embodiments, the electromagneticradiation reflected by the object is generated by a light source (notshown) coupled to depth sensing pixel 100. Sensing circuit 110 includesa photodiode (PD) which is sensitive to electromagnetic radiation.Photodiode PD is coupled to a transistor PH and to a transistor PHB. Agate of transistor PH is configured to receive a signal which iscomplementary with respect to a signal received by a gate of transistorPHB. In some embodiments, the gate of transistor PH is configured toreceive a signal which is in phase with a pulse from the light source.Sensing circuit 110 further includes a first photo storage diode PSD1coupled to an opposite side of transistor PH from photodiode PD. Asecond photo storage diode PSD2 is coupled to an opposite side oftransistor PHB from photodiode PD. Sensing circuit 110 further includesa first transfer gate TGA configured to selectively couple first photostorage diode PSD1 with readout circuit 120. A second transfer gate TGBis configured to selectively couple second photo storage diode PSD2 withreadout circuit 120.

Readout circuit 120 is configured to transfer an output from sensingcircuit 110 to downstream circuits such as amplifiers oranalog-to-digital (AD) converters. A node FD is located between readoutcircuit 120 and sensing circuit 110. Node FD is also known as a floatingdiffusion node, in some embodiments. Readout circuit 120 includes areset transistor RST configured to selectively couple FD node to asupply voltage VCC to pull-high the FD node before the stored photocharges are transferred to the FD node by turning on the transfer gatesTGA or TGB. A gate of a source follower SF is coupled to node FD. A rowselect transistor RSL is coupled between source follower SF and theexternal circuits. In some embodiments, the external circuit is aconstant current source. When the row select transistor RSL is turned onduring the readout time, the source follower SF is activated and coupledto the external circuits. When the row select transistor is turned offduring the integration time and the idle time, the source follower isdeactivated and isolated from the external circuits. After the photocharges are transferred from the photo storage diode PSD to the FD node,the voltage of the FD node decreases proportionally to the amount ofphoto charges transferred. The downstream readout circuits samples theFD node voltage before the charge transfer, and after the chargetransfer; amplify the difference between the first sampling and thesecond sampling; and perform the AD conversion. The above describedprocess is commonly referred to as the correlated double sampling, orthe CDS. Since the KTC noise, or the reset noise, are the same(correlated) during the first sampling and the second sampling, KTCnoise are reduced or eliminated by subtraction either in analog circuitsor in digital circuits. KTC noise is associated with the diffusionjunction capacitance of the FD node, the gate capacitance of the SFtransistor, and the parasitic capacitance between the FD node andvarious metal layers, vias, and contacts.

Photodiode PD is configured to receive electromagnetic radiation andconvert the electromagnetic radiation into an electrical charge. In someembodiments, a waveband of the electromagnetic radiation is nearinfrared (NIR) radiation, e.g., about 780 nanometers (nm) to about 2,500nm. In some embodiments, photodiode PD is a pinned photodiode. A pinnedphotodiode is a pn-junction diode with a shallow and heavily-dopedpinning layer to pin the diode surface potential to substrate to createa specific potential profile such that a complete charge transfer fromthe pinned photodiode to the photo storage diode is possible when thetransfer gate is biased higher than a pinning voltage. In someembodiments, photodiode PD is configured to receive the electromagneticradiation through an interconnect structure, i.e., the photodiode ispart of a front-side illuminated (FSI) image sensor. In someembodiments, photodiode PD is configured to receive the electromagneticradiation without the electromagnetic radiation propagating through aninterconnect structure, i.e., the photodiode is part of a back-sideilluminated (BSI) image sensor.

Transistor PH is configured to selectively couple photodiode PD to firstphoto storage diode PSD1. A conductivity of transistor PH is determinedbased on a signal applied to the gate of the transistor. In someembodiments, the signal applied to the gate of transistor PH isgenerated by a clock circuit (not shown). In some embodiments, the clockcircuit is also usable to control a light source for emittingelectromagnetic radiation toward an object detected by depth sensingpixel 100. In some embodiments, transistor PH is controlled to beconductive while the light source is emitting the electromagneticradiation, i.e., the transistor is in-phase with the light source. Insome embodiments, transistor PH is not in-phase with the light source.In some embodiments, transistor PH is a metal-oxide-semiconductor (MOS)transistor. In some embodiments, transistor PH is a high electronmobility transistor (HEMT), a bi-polar junction transistor (BJT), a finfield-effect-transistor (FinFET), or another suitable transistor. Insome embodiments, photodiode PD is coupled to a drain of transistor PH.In some embodiments, photodiode PD is coupled to a source of transistorPH.

Transistor PHB is configured to selectively couple photodiode PD tosecond photo storage diode PSD2. A conductivity of transistor PHB isdetermined based on a signal applied to the gate of the transistor. Insome embodiments, the signal applied to the gate of transistor PHB isgenerated by the clock circuit. In some embodiments, transistor PHB iscontrolled to be conductive while the light source is not emitting theelectromagnetic radiation, i.e., the transistor is out of phase with thelight source. In some embodiments, transistor PHB is in-phase with thelight source. In some embodiments, transistor PHB is a MOS transistor.In some embodiments, transistor PHB is an HEMT, a BJT, a FinFET, oranother suitable transistor. In some embodiments, transistor PHB is asame transistor type as transistor PH. In some embodiments, transistorPHB is a different transistor type from transistor PH. In someembodiments, photodiode PD is coupled to a drain of transistor PHB. Insome embodiments, photodiode PD is coupled to a source of transistorPHB.

First photo storage diode PSD1 is configured to receive a charge fromphotodiode PD through transistor PH. First photo storage diode PSD1 iscapable of storing a greater charge than photodiode PD. In someembodiments, a storage capacity of the first photo storage diode issufficient to help with transferring all charge from the photodiodeduring a conductive state of transistor PH. Transferring all charge fromphotodiode PD to first photo storage diode PSD1 helps to avoid signalloss during detection of incident electromagnetic radiation. In someembodiments, photo storage diode PSD1 is configured to store chargesreceived from photodiode PD which are in-phase with light transmittedfrom the light source.

Second photo storage diode PSD2 is configured to receive a charge fromphotodiode PD through transistor PHB. Second photo storage diode PSD2 iscapable of storing a greater charge than photodiode PD. In someembodiments, a storage capacity of the second photo storage diode issufficient to help with transferring all charge from the photodiodeduring a conductive state of transistor PHB. Transferring all chargefrom photodiode PD to second photo storage diode PSD2 helps to avoidsignal loss during detection of incident electromagnetic radiation. Insome embodiments, a storage capacity of second photo storage diode PSD2is equal to a storage capacity of first photo storage diode PSD1. Insome embodiments, the storage capacity of second photo storage diodePSD2 is different from the storage capacity of first photo storage diodePSD1. In some embodiments, photo storage diode PSD2 is configured tostore charges received from photodiode PD which are out-of-phase withlight transmitted from the light source.

In a depth sensing operation, the received light reflected from anobject and the transmitted light has a phase difference, which isproportional to a distance between the light source and the object to bedetected. A delay between the received reflected light and thetransmitted light is commonly referred to as the time of flight. Some ofthe photo charges captured by photodiode PD are generated in-phase withthe transmitted light of the light source, and some of the photo chargesare generated out-of-phase with the transmitted light of the lightsource. In some embodiments, transistor PH is controlled by a pulsetrain in-phase with the light source such that the in-phase photocharges are collected by the photo storage diode PSD1, and transistorPHB is controlled by a pulse train out-of-phase with the light sourcesuch that the out-of-phase charges are collected by the photo storagediode PSD2. The difference between the in-phase photo charges and theout-of-phase photo charges is proportional to the distance, or thedepth, of the object to be detected. The purpose of transistor PH andtransistor PHB is to separate the in-phase and out-of-phase charges intophoto storage diode PSD1 and photo storage diodePSD2, respectively. Thestored charges on photo storage diode PSD1 and photo storage diode PSD2are to be read out by the CDS operation after a programmed amount ofintegration time, either sequentially through a common single readoutport, or in parallel through two separate readout ports. The results ofthe two readouts are then processed by analog or digital circuits toextract the depth information.

First transfer gate TGA is configured to transfer the charge from firstphoto storage diode PSD1 to node FD in response to a control signal. Insome embodiments, the control signal applied to the gate of firsttransfer gate TGA is generated by the clock circuit, a driver, aselection circuit or another suitable control device. In someembodiments, the control signal is temporally offset with respect to thesignal applied to the gate of transistor PH. In some embodiments, thecontrol signal is substantially in-phase with the signal applied to thegate of transistor PHB. In some embodiments, first transfer gate TGA isa MOS transistor. In some embodiments, first transfer gate TGA is anHEMT, a BJT, a FinFET, or another suitable transfer device. In someembodiments, first photo storage diode PSD1 is coupled to a drain offirst transfer gate TGA. In some embodiments, first photo storage diodePSD1 is coupled to a source of first transfer gate TGA.

Second transfer gate TGB is configured to transfer the charge fromsecond photo storage diode PSD2 to node FD in response to a controlsignal. In some embodiments, the control signal applied to the gate ofsecond transfer gate TGB is generated by the clock circuit, the driver,the selection circuit or another suitable control device. In someembodiments, the control signal is temporally offset with respect to thesignal applied to the gate of transistor PHB. In some embodiments, thecontrol signal is substantially in-phase with the signal applied to thegate of transistor PH. In some embodiments, second transfer gate TGB isa MOS transistor. In some embodiments, second transfer gate TGB is anHEMT, a BJT, a FinFET, or another suitable transfer device. In someembodiments, second transfer gate TGB is a same type of device as firsttransfer gate TGA. In some embodiments, second transfer gate TGB is adifferent type of device from first transfer gate TGB. In someembodiments, second photo storage diode PSD2 is coupled to a drain ofsecond transfer gate TGB. In some embodiments, second photo storagediode PSD2 is coupled to a source of second transfer gate TGB. Node FDis connected to an output of sensing circuit 110 and an input of readoutcircuit 120 through the column bus COL. When a pixel is selected byactivating the RSL transistor, the voltage at the column bus COL afterthe source follower SF follows proportionally to the FD voltage beforethe source follower SF. The downstream readout circuit samples thevoltage of COL before and after the charge transfer, and the differencebetween two sampling is proportional to the FD node voltage difference,and therefore proportional to the charge transferred. A storage capacityof node FD is greater than the storage capacity of first photo storagediode PSD1 and the storage capacity of second photo storage diode PSD2to help transfer charge to the node through first transfer gate TGA orsecond transfer gate TGB.

Reset transistor RST is configured to return the voltage level of nodeFD to the supply voltage in the case of the hard-reset, or onethreshold-voltage below the supply voltage in the case of thesoft-reset, before or after reading out the charge from sensing circuit110. In some embodiments, reset transistor RST is between node FD and areference voltage, and the reset transistor is configured to return thevoltage level of the node to the reference voltage. A conductivity ofreset transistor RST is determined based on a reset signal applied to agate of the reset transistor. In some embodiments, the reset signal isgenerated by the clock circuit, or another suitable controlling device.In some embodiments, reset transistor RST is a MOS transistor. In someembodiments, reset transistor RST is an HEMT, a BJT, a FinFET, oranother suitable transistor.

Source follower SF includes a gate coupled to the node FD. The voltagelevel at node FD determines a conductivity of source follower SF. Insome embodiments, source follower SF is in a non-conductive statefollowing the reset of node FD to the supply voltage. In someembodiments, source follower SF is in a saturated state following thereset of node FD to the supply voltage. In some embodiments, sourcefollower SF is a MOS transistor. In some embodiments, source follower SFis an HEMT, a BJT, a FinFET, or another suitable transistor. In someembodiments, source follower SF is a same transistor type as resettransistor RST. In some embodiments, source follower SF is a differenttype of transistor from reset transistor RST.

Row select transistor RSL is coupled to source follower SF and a voltagebetween the row select transistor and the source follower is determinedbased on a conductivity of the source follower. The voltage between rowselect transistor RSL and source follower SF is transferred to externalcircuit upon activation of the row select transistor. A gate of rowselect transistor RSL is configured to receive a row selection signal.In some embodiments, the row selection signal is generated by the clockcircuit, a driver, a selection circuit or another suitable controllingdevice. In some embodiments, row select transistor RSL is a MOStransistor. In some embodiments, row select transistor RSL is an HEMT, aBJT, a FinFET, or another suitable transistor. In some embodiments, rowselect transistor RSL is a same transistor type as at least one of resettransistor RST or source follower SF. In some embodiments, row selecttransistor RSL is a different type of transistor from at least one ofreset transistor RST or source follower SF.

In some comparison with other approaches, depth sensing circuit 100includes a single readout port, where both of the in-phase chargesstored on PSD1 and the out-of-phase charges stored on PSD2 are read outthrough the shared FD node and operated by the shared readout portincluding the RST, SF, and RSL devices. The single readout port reducesan overall size of depth sensing circuit 100 in comparison with otherapproaches which include multiple readout ports. Depth sensing circuit100 also reduces mismatches, such as a mismatch resulting from thethreshold voltages of reset transistor RST and source follower SF, incomparison with other approaches by providing both in-phase andout-of-phase readout along a same signal chain.

FIG. 2A is a flowchart of a method 200 of using a depth sensing pixel inaccordance with some embodiments. Method 200 begins with receivingelectromagnetic radiation at a photodiode in operation 202. In someembodiments, the electromagnetic radiation is NIR radiation. Thephotodiode converts the received electromagnetic radiation into anelectrical charge. In some embodiments, the electrical charge resultingfrom the received electromagnetic radiation is called a photo charge. Insome embodiments, the photodiode is part of a front-side illuminatedimage sensor. In some embodiments, the photodiode is part of a back-sideilluminated image sensor. In some embodiments, the photodiode isphotodiode PD (FIG. 1).

In operation 204, the photo charge is transferred from the photodiode toa first photo storage diode. A storage capacity of the first photostorage diode is greater than a storage capacity of the photodiode. Insome embodiments, a storage capacity of the first photo storage diode issufficient to help completely transfer photo charge from the photodiodeto the first photo storage diode. In some embodiments, the photo chargeis transferred during a time domain which is in-phase with operation ofa light source associated with the depth sensing pixel. In someembodiments, the photo charge is transferred during a time domain whichis out of phase with operation of the light source associated with thedepth sensing pixel. In some embodiments, the first photo storage diodeis first photo storage diode PSD1 (FIG. 1) or second photo storage diodePSD2. In some embodiments, the photo charge is transferred usingtransistor PH or transistor PHB.

FIG. 2B is a diagram of charge transfer during operation 204 inaccordance with some embodiments. FIG. 2B includes a light shield 230configured to limit propagation of an incident light beam 240 to thephotodiode PPD. FIG. 2B indicates a transfer of charge from photodiodePPD to second photo storage diode PSD2. A depth of second photo storagediode PSD2 is greater than a depth of photodiode PPD to illustrate theincreased storage capacity of second photo storage diode PSD2 inrelation to photodiode PPD. In some embodiments, charge from photodiodePPD is transferred to first photo storage diode PSD1 instead of secondphoto storage diode PSD2.

In operation 206, a photo charge is transferred from the photodiode to asecond photo storage diode. The photo charge transferred from thephotodiode to the second photo storage diode is different from the photocharge transferred to the first photo storage diode. The photo chargetransferred from the photodiode to the second photo storage diode iscollected by the photodiode in a sequential manner with respect to thephoto charge transferred to the first photo storage device. A storagecapacity of the second photo storage diode is greater than a storagecapacity of the photodiode. In some embodiments, a storage capacity ofthe second photo storage diode is sufficient to help completely transferphoto charge from the photodiode to the second photo storage diode. Insome embodiments, the photo charge is transferred during a time domainwhich is in-phase with operation of the light source associated with thedepth sensing pixel. In some embodiments, the photo charge istransferred during a time domain which is out of phase with operation ofthe light source associated with the depth sensing pixel. In someembodiments, the second photo storage diode is first photo storage diodePSD1 (FIG. 1) or second photo storage diode PSD2. In some embodiments,the photo charge is transferred using transistor PH or transistor PHB.

FIG. 2C is a diagram of charge transfer during operation 206 inaccordance with some embodiments. FIG. 2C indicates a transfer of chargefrom photodiode PPD to first photo storage diode PSD1. A depth of firstphoto storage diode PSD1 is greater than a depth of photodiode PPD toillustrate the increased storage capacity of first photo storage diodePSD1 in relation to photodiode PPD. In some embodiments where charge istransferred from photodiode PPD to first photo storage diode PSD1 inoperation 204, charge from photodiode PPD is transferred to second photostorage diode PSD2 instead of first photo storage diode PSD1 inoperation 206.

A voltage level of a FD node and column bus COL is reset in operation208. The voltage level of the FD node is reset by selectively couplingthe FD node to a supply voltage or a reference voltage. In someembodiments, the voltage level of the FD node is reset using a resettransistor, e.g., reset transistor RST (FIG. 1). In some embodiments,the readout voltage on column bus COL, which follows the voltage of FDnode, is reset using the reset transistor and a row select transistor,e.g., row select transistor RSL. A readout circuit samples the columnbus COL voltage after the FD reset.

In operation 210, the charged stored in the first photo storage diode istransferred to the FD node. A storage capacity of the FD node is greaterthan the storage capacity of the first photo storage device. In someembodiments, a storage capacity of the readout node is sufficient tohelp completely transfer the photo charge from the first photo storagediode to the FD node. In some embodiments, the stored charge istransferred using first transfer gate TGA (FIG. 1) or second transfergate TGB.

FIG. 2D is a diagram of charge transfer during operation 210 inaccordance with some embodiments. FIG. 2D indicates a transfer of chargefrom second photo storage diode PSD2 to the FD node. A depth of the FDnode is greater than a depth of second photo storage diode PSD2 toillustrate the increased storage capacity of the FD node in relation tosecond photo storage diode PSD2. In some embodiments where charge istransferred from photodiode PPD to first photo storage diode PSD1 inoperation 204, charge from first photo storage diode PSD1 is transferredto the FD node in operation 210.

The voltage at the column bus COL is read out in operation 212. Thevoltage at the column bus COL is read out to external circuits. In someembodiments, the voltage at the FD node is read out using a sourcefollower, e.g., source follower SF (FIG. 1), and a row selecttransistor, e.g., row select transistor RSL.

In operation 214, a first correlated double sampling (CDS) is performedon the two voltages read out from the readout node at operations 208 and212. CDS is a method used to measure electrical values that reducesundesired offset. The output, e.g., the voltage read out from the columnbus COL, is measured twice, once with a known reset condition before thecharge transfer and once with an unknown, signal-dependent conditionafter the charge transfer. A difference between the measured value withthe known condition and the measured value with the unknown condition isused to reduce noise and offset within the measurement. In someembodiments, the noise is the KTC noise or the reset noise, and theoffset could be the threshold voltage variation of the reset transistorRST and source follower SF. The first CDS is performed by the externalcircuits. In some embodiments, the known condition is the voltage levelof the readout node following operation 208.

A voltage level of a FD node and the column bus COL is reset inoperation 216. The voltage level of the FD node is reset by selectivelycoupling the readout node to a supply voltage or a reference voltage. Insome embodiments, the voltage level of the FD node is reset using areset transistor, e.g., reset transistor RST (FIG. 1). In someembodiments, the readout voltage on column bus COL, which follows thevoltage of FD node, is reset using the reset transistor and a row selecttransistor, e.g., row select transistor RSL. A readout circuit samplesthe column bus COL voltage after the FD reset.

In operation 218, the charge stored in the second photo storage diode istransferred to the FD node. A storage capacity of the readout node isgreater than the storage capacity of the second photo storage device. Insome embodiments, a storage capacity of the readout node is sufficientto help completely transfer the photo charge from the second photostorage diode to the FD node. In some embodiments, the stored charge istransferred using first transfer gate TGA (FIG. 1) or second transfergate TGB.

FIG. 2E is a diagram of charge transfer during operation 218 inaccordance with some embodiments. FIG. 2E indicates a transfer of chargefrom first photo storage diode PSD1 to the FD node. A depth of the FDnode is greater than a depth of first photo storage diode PSD1 toillustrate the increased storage capacity of the FD node in relation tofirst photo storage diode PSD1. In some embodiments where charge istransferred from photodiode PPD to first photo storage diode PSD1 inoperation 204, charge from second photo storage diode PSD2 istransferred to the FD node in operation 218.

The voltage at the readout node is read out in operation 220. Thevoltage at the readout node is read out to external circuits. In someembodiments, the charge at the readout node is read out using a sourcefollower, e.g., source follower SF (FIG. 1), and a row selecttransistor, e.g., row select transistor RSL.

In operation 222, a second CDS is performed on the charge read out fromthe readout node. The second CDS is performed by the external circuits.In some embodiments, the second CDS is performed using a same circuit asthe first CDS. In some embodiments, the second CDS is performed using adifferent circuit from the first CDS.

A distance to a detected objected is calculated in operation 224. Thedistance to the detected object is calculated based on results of thefirst CDS from operation 214 and results of the second CDS fromoperation 222. In some embodiments, the distance to the detected objectis calculated using external circuitry such as analog circuits ordigital circuits. In some embodiments, a distance to multiple detectedobjects is calculated in operation 224.

In some embodiments, an order of the operations of method 200 isaltered. In some embodiments, at least one operation of method 200 iscombined with at least another operation of the method. In someembodiments, additional operations are included in method 200. In someembodiments, the floating-diffusion node FD, the photo storage nodesPSD1 and PSD2 are shielded from the incident light by one or acombination of multiple metal layers such that the photo carriers areonly generated in the pinned photo diode PPD, not in FD, PSD1, or PSD2.FIGS. 2-1, 2-2, 2-3, and 2-4 are simplified electronic potentialprofiles corresponding to the operations 204, 206, 210, and 218,respectively, where the metal shield 230 prevents the generation ofphoto carriers in FD, PSD1, and PSD2.

FIG. 3 is a top view of a layout 300 of a depth sensing pixel inaccordance with some embodiments. Layout 300 includes a sensing circuitlayout 310 and a readout circuit layout 320. Elements in sensing circuitlayout 310 are to the same as elements in sensing circuit 110 (FIG. 1)and have a same reference character. Elements in readout circuit layout320 the same as elements in readout circuit 120 and have a samereference character. Node FD in sensing circuit layout 310 is coupled tonode FD in readout circuit layout 320 by an interconnect structure 330.

Photodiode PD is configured to receive electromagnetic radiation andconvert the received electromagnetic radiation to an electrical charge.The electrical charge is then able to be transferred to first photostorage diode PSD1 across transistor PH, or to second photo storagediode PSD2 across transistor PHB. The electrical charge stored in firstphoto storage diode PSD1 is transferable to node FD across firsttransfer gate TGA. The electrical charge stored in second photo storagediode PSD2 is transferable to node FD across second transfer gate TGB.

Node FD of sensing circuit layout 310 is coupled to node FD of readoutcircuit layout 320 by interconnect structure 330. Reset transistor RSTis usable to reset the voltage level of node FD to a supply voltage VCC.Node FD is coupled to source follower SF by the interconnect structure.Based on a voltage level of node FD, supply voltage VCC is transferableto the node between source follower SF and row select transistor RSL. Insome embodiments, the supply voltage is a VDD voltage. Row selecttransistor RSL is able to be activated based on a row select signalprovided through the interconnect structure. The voltage level betweensource follower SF and row select transistor RSL is transferable to anoutput OUT based on the voltage level of the row select signal.

Readout circuit layout 320 is spaced from sensing circuit layout 310. Insome embodiments, readout circuit layout 320 is contiguous with readoutcircuit layout 310. In some embodiments, nodes FD on opposite sides ofsensing circuit layout 310 are coupled together by the interconnectstructure. In some embodiments, nodes FD on opposite sides of sensingcircuit layout 310 are separately coupled to node FD of readout circuitlayout 320.

FIG. 4 is a schematic diagram of a composite pixel image sensor 400 inaccordance with some embodiments. Composite pixel image sensor 400includes an image sensing array 410 bonded to a depth sensing pixel 420at a bonding interface 430. Image sensing array 410 is configured todetect electromagnetic radiation from an object where the radiation isin a first spectrum. Depth sensing pixel 420 is configured to detectelectromagnetic radiation from the object where the radiation is in asecond spectrum different from the first spectrum. Image sensing array410 is bonded to depth sensing pixel 420 at bonding interface 430 toform an integrated structure. Incoming electromagnetic radiationpropagates through image sensing array 410 to reach depth sensing pixel420.

Image sensing array 410 is used to detect electromagnetic radiation fromthe object in the first spectrum. In some embodiments, the firstspectrum is a visible spectrum, e.g., having a waveband from about 390nm to about 700 nm. Image sensing array 410 includes a plurality ofphotodiodes PD1, PD2, PD3 and PD4. A first transfer gate TG1 couplesfirst photo diode PD1 to a readout circuit 415. A second transfer gateTG2 couples second photo diode PD2 to readout circuit 415. A thirdphotodiode PD3 is coupled to readout circuit 415 by a third transfergate TG3. A fourth photodiode PD4 is coupled to readout circuit 415 by afourth transfer gate TG4. Readout circuit 415 is configured to read outthe FD1 voltages before and after each charge transfer from PD1, PD2,PD3, PD4 to FD1 separately. Readout circuit 415 includes elements whichare the same as readout circuit 120 (FIG. 1) and the same elements havea same reference character with the number “1” appended.

In some embodiments, at least one photodiode of the plurality ofphotodiodes PD1, PD2, PD3 or PD4 is a pinned photodiode. In someembodiments, at least one photodiode of the plurality of photodiodesPD1, PD2, PD3 or PD4 is configured to detect a different wavelength fromat least another of the plurality of photodiodes PD1, PD2, PD3 or PD4.In some embodiments, at least one photodiode of the plurality ofphotodiodes PD1, PD2, PD3 or PD4 is configured to detect a samewavelength from at least another of the plurality of photodiodes PD1,PD2, PD3 or PD4, by coating different color filters on top of them. Insome embodiments, a first photodiode PD1 is configured to detectelectromagnetic radiation in a green spectrum, e.g., having a wavebandfrom about 495 nm to about 570 nm. In some embodiments, a secondphotodiode PD2 is configured to detect electromagnetic radiation in ared spectrum, e.g., having a waveband from about 620 nm to about 700 nm.In some embodiments, a third photodiode PD3 is configured to detectelectromagnetic radiation in a blue spectrum, e.g., having a wavebandfrom about 450 nm to about 495 nm. In some embodiments, a fourthphotodiode PD4 is configured to detect electromagnetic radiation in agreen spectrum, e.g., having a waveband from about 495 nm to about 570nm.

In some embodiments, image sensing array 410 is arranged as a back-sideilluminated image sensor so that an interconnect structure (not shown)is between the plurality of photodiodes PD1, PD2, PD3 and PD4 and depthsensing pixel 420. In some embodiments, image sensing array 410 isarranged as a front-side illuminated image sensor so that theinterconnect structure is on a side of the plurality of photodiodes PD1,PD2, PD3 and PD4 opposite depth sensing pixel 420.

Depth sensing circuit 420 is similar to depth sensing circuit 100 (FIG.1). In comparison with depth sensing circuit 100, a photodiode,corresponding to photodiode PD, of depth sensing circuit 420 is labeledPDS. In comparison with depth sensing circuit 100, a first transfergate, corresponding to first transfer gate TGA, of depth sensing circuit420 is labeled TGS. In comparison with depth sensing circuit 100, asecond transfer gate, corresponding to second transfer gate TGB, ofdepth sensing circuit 420 is labeled TG6. Depth sensing circuit 420includes a readout circuit 425 which corresponds to readout circuit 120and the same elements have a same reference character with the number“2” appended.

In some embodiments, depth sensing pixel 420 is arranged as a front-sideilluminated image sensor so that an interconnect structure (not shown)is between photodiode PDS and image sensing array 410. In someembodiments, depth sensing pixel 420 is arranged as a back-sideilluminated image sensor so that the interconnect structure is on a sideof photodiode PDS opposite image sensing array 410.

Bonding interface 430 is a location where image sensing array 410 isbonded to depth sensing pixel 420. In some embodiments, bondinginterface 430 includes a fusion bond between image sensing array 410 anddepth sensing pixel 420. In some embodiments, the fusion bond includes asilicon-silicon oxide bond, a silicon oxide-silicon oxide bond, asilicon-silicon bond, or another suitable fusion bond. In someembodiments, a metallic material is formed on at least one of imagesensing array 410 or depth sensing pixel 420. In some embodiments,bonding interface includes a eutectic bond. In some embodiments, theeutectic bond includes a silicon-metallic bond, a metallic-metallicbond, a silicon oxide-metallic bond, or another suitable eutectic bond.

Composite pixel image sensor 400 includes four photodiodes PD1, PD2, PD3and PD4 in image sensing array 410; and one photodiode PD5 in depthsensing pixel 420. In some embodiments, a different number ofphotodiodes is included in at least one of image sensing array 410 ordepth sensing pixel 420.

In operation, composite pixel image sensor 400 receives electromagneticradiation from the first spectrum and the second spectrum. Theelectromagnetic radiation from the first spectrum is detected by imagesensing array 410. The electromagnetic radiation from the secondspectrum is detected by depth sensing pixel 420. In some embodiments,color filters are between image sensing array 410 and the incomingelectromagnetic radiation. The color filters permit propagation ofradiation of a particular waveband to permit a specific photodiode ofimage sensing array 410 to detect a specific color of electromagneticradiation. In some embodiments where the second spectrum includes NIRradiation, color filters also transmit a sufficient amount of NIRradiation to permit detection of the NIR radiation by depth sensingpixel 420. In addition, NIR radiation penetrates deeper into siliconthan visible radiation. Thus, sufficient NIR radiation is detected bydepth sensing pixel 420 to distinguish detected NIR radiation fromsignal noise.

FIG. 5 is a schematic diagram of a composite pixel image sensor 500 inaccordance with some embodiments. Composite pixel image sensor 500 issimilar to composite pixel image sensor 400 (FIG. 4) and the sameelements have a same reference number increased by 100. In comparisonwith composite pixel image sensor 400, image sensing array 510 does notinclude a separate readout circuit. Instead, readout circuit 525 isshared by both image sensing array 510 and depth sensing pixel 520. Aconnection 535 at bonding interface 530 is usable to transfer readoutsignals from image sensing array 510 to readout circuit 525. Incomparison with composite pixel image sensor 400, a size of pixel imagesensor 500 is reduced by using a single readout circuit 525.

In comparison with composite pixel image sensor 400, bonding interface530 includes a hybrid bond in some embodiments. A hybrid bond is acombination of a fusion bond and a eutectic bond. For example,connection 535 is usable to form a eutectic bond, while portions ofimage sensing array 510 and depth sensing pixel 520 different from theconnection are usable to form a fusion bond. In some embodiments,bonding interface 530 include a metallic layer, other than connection535, between image sensing array 510 and depth sensing pixel 520. Themetallic layer is electrically separated from connection 535 by adielectric material. The dielectric material is able to be bonded toimage sensing array 510 or depth sensing pixel 520 to form a fusionbond, in some embodiments. The metallic layer is able to form a largereutectic bond area in comparison with embodiments which do not includethe metallic layer.

FIG. 6 is a schematic diagram of a composite pixel image sensor 600 inaccordance with some embodiments. Composite pixel image sensor 600 issimilar to composite pixel image sensor 400 (FIG. 4) and the sameelements have a same reference number increased by 200. In comparisonwith composite pixel image sensor 400, depth sensing pixel 620 does notinclude a separate readout circuit. Instead, readout circuit 615 isshared by both image sensing array 610 and depth sensing pixel 620. Aconnection 635 at bonding interface 630 is usable to transfer readoutsignals from depth sensing pixel 620 to readout circuit 615. Incomparison with composite pixel image sensor 400, a size of pixel imagesensor 600 is reduced by using a single readout circuit 625.

In comparison with composite pixel image sensor 400, bonding interface630 includes a hybrid bond in some embodiments. For example, connection635 is usable to form a eutectic bond, while portions of image sensingarray 610 and depth sensing pixel 620 different from the connection areusable to form a fusion bond. In some embodiments, bonding interface 630include a metallic layer, other than connection 635, between imagesensing array 610 and depth sensing pixel 620. The metallic layer iselectrically separated from connection 635 by a dielectric material. Thedielectric material is able to be bonded to image sensing array 610 ordepth sensing pixel 620 to form a fusion bond, in some embodiments.

FIG. 7 is a schematic diagram of a composite pixel image sensor 700 inaccordance with some embodiments. Composite pixel image sensor 700 issimilar to composite pixel image sensor 400 (FIG. 4) and the sameelements have a same reference number increased by 300. In comparisonwith composite pixel image sensor 400, portions of a readout circuit aresplit between image sensing array 710 and depth sensing pixel 720.Composite pixel image sensor 700 includes reset transistor RST as partof image sensing array 710, and source follower SF and row selecttransistor RSL as part of depth sensing pixel 720. In some embodiments,portions of the readout circuit are distributed differently betweenimage sensing array 710 and depth sensing pixel 720. A connection 735 atbonding interface 730 is usable to transfer signals between differentportions of the readout circuit. In comparison with composite pixelimage sensor 400, a size of pixel image sensor 700 is reduced by using asingle readout circuit 725. In addition, separating components ofreadout circuit 725 helps to further reduce a size of composite pixelimage sensor 700 in comparison with composite pixel image sensor 400because the components are able to be located in available space ineither image sensing array 710 or depth sensing pixel 720.

In comparison with composite pixel image sensor 400, bonding interface730 includes a hybrid bond in some embodiments. For example, connection735 is usable to form a eutectic bond, while portions of image sensingarray 710 and depth sensing pixel 720 different from the connection areusable to form a fusion bond. In some embodiments, bonding interface 730include a metallic layer, other than connection 735, between imagesensing array 710 and depth sensing pixel 720. The metallic layer iselectrically separated from connection 735 by a dielectric material. Thedielectric material is able to be bonded to image sensing array 710 ordepth sensing pixel 720 to form a fusion bond, in some embodiments.

FIG. 8 is a cross-sectional view of a composite pixel image sensor 800in accordance with some embodiments. Composite pixel image sensor 800includes an image sensing array 810 bonded to a depth sensing pixelarray 820 at a bonding interface 830.

Image sensing array 810 includes an array of photodiodes 812. Aninterconnect structure 814 is coupled to the array of photodiodes 812.Interconnect structure 814 is used to couple various devices withinimage sensing array 810. In some embodiments, interconnect structure 814includes conductive features separated a dielectric material such assilicon oxide. In some embodiments, the dielectric material is amaterial other than silicon oxide. A limited number of conductivefeatures within interconnect structure 814 are depicted for simplicity.Color filters 816 are over the array of photodiodes 812. A lens array818 is over color filters 816. Lens array 818 and color filters 816 areusable to focus a predefined spectrum of incoming electromagneticradiation onto a corresponding photodiode 812 of the array ofphotodiodes.

Depth sensing pixel array 820 includes an array of depth sensing pixels822. An interconnect structure 824 is over the array of depth sensingphotodiodes 822. Interconnect structure 824 is used to couple variousdevices within depth sensing pixel array 820. Interconnect structure 824is used to couple various devices within depth sensing pixel array 820.In some embodiments, interconnect structure 824 includes conductivefeatures separated a dielectric material such as silicon oxide. In someembodiments, the dielectric material is a material other than siliconoxide. A limited number of conductive features within interconnectstructure 824 are depicted for simplicity.

Bonding interface 830 includes connections 835 between interconnectstructure 814 and interconnect structure 824. In some embodiments,connections 835 include conductive pads of interconnect structure 814 orinterconnect structure 824. In some embodiments, connections 835 includeconductive pillars extending from interconnect structure 814 orinterconnect structure 824. Bonding interface 830 includes a hybridbond. The hybrid bond includes a eutectic bond at connections 835 and afusion bond between interconnect structure 814 and interconnectstructure 824.

Composite pixel image sensor 800 includes image sensing array 810 as aback-side illuminated image sensor and depth sensing pixel array as afront-side illuminated image sensor. As a result, the fusion bond atbonding interface 830 is a silicon oxide-silicon oxide bond in someembodiments. In some embodiments, image sensing array 810 as afront-side illuminated image sensor and depth sensing pixel array as afront-side illuminated image sensor producing a silicon-silicon oxidefusion bond in some embodiments. In some embodiments, image sensingarray 810 as a front-side illuminated image sensor and depth sensingpixel array as a back-side illuminated image sensor producing asilicon-silicon fusion bond in some embodiments. In some embodiments,image sensing array 810 as a back-side illuminated image sensor anddepth sensing pixel array as a back-side illuminated image sensorproducing a silicon oxide-silicon fusion bond in some embodiments.

In operation, in some embodiments, electromagnetic radiation is incidenton lens array 818. The electromagnetic radiation propagates throughcolor filters 816, which remove a portion of a visible spectrum from theincident electromagnetic radiation. Color filters 816 do not remove asubstantial portion of NIR radiation from the incident electromagneticradiation. A first portion of the electromagnetic radiation passed bycolor filters 816 is received the array of photodiodes 810. The array ofphotodiodes 810 converts the received electromagnetic radiation into anelectrical charge. The electrical charge is transferred to a readoutcircuit (not shown) by interconnect structure 814. In some embodiments,image sensing array 810 includes a separate readout circuit from depthsensing pixel array 820. In some embodiments, image sensing array 810shares the readout circuit with depth sensing pixel array 820. A secondportion of the electromagnetic radiation passed by color filters isreceived by array of depth sensing photodiodes 822. The array of depthsensing photodiodes 822 converts the received electromagnetic radiationinto an electrical charge. The electrical charge is transferred to areadout circuit by interconnect structure 824.

FIG. 9A is a view of positional arrangement 900 of a composite pixelimage sensor in accordance with some embodiments. Positional arrangement900 includes a 4:1 ratio of image sensing pixels 910 to depth sensingpixels 920. Image sensing pixels 910 are arranged in a 4×4 array anddepth sensing pixels 920 are arranged 2×2 array. Letters included ineach of the image sensing pixels 910 identify an example color filterassociated with that image sensing pixel. The letter ‘R’ indicates a redspectrum color filter; the letter ‘B’ indicates a blue spectrum colorfilter; and the letter ‘G’ indicates a green spectrum color filter. Insome embodiments, image sensing pixels 910 are arranged in a Bayerfilter pattern. In some embodiments, a single readout circuit is sharedbetween four image sensing pixels 910 and one depth sensing pixel 920.

FIG. 9B is a view of positional arrangement 900′ of a composite pixelimage sensor in accordance with some embodiments. Positional arrangement900′ includes an 8:1 ratio of image sensing pixels 910′ to depth sensingpixels 920′. Image sensing pixels 910′ are arranged in a 4×4 array anddepth sensing pixels 920′ are arranged 2×1 array. In some embodiments, asingle readout circuit is shared between eight image sensing pixels 910′and one depth sensing pixel 920′.

FIG. 9C is a view of positional arrangement 900″ of a composite pixelimage sensor in accordance with some embodiments. Positional arrangement900″ includes a 16:1 ratio of image sensing pixels 910″ to depth sensingpixels 920″. Image sensing pixels 910″ are arranged in a 4×4 array and asingle depth sensing pixels 920″ is included. In some embodiments, asingle readout circuit is shared between sixteen image sensing pixels910″ and the single depth sensing pixel 920″.

FIG. 10 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments. The positionalarrangement in FIG. 10 is the same as positional arrangement 900 (FIG.9A). The schematic diagram of the composite pixel image sensor is thesame as composite pixel image sensor 500 (FIG. 5). In the embodiment ofFIG. 10, a single shared readout circuit is located in the depth sensingpixel. In some embodiments, separate readout circuits are located in thedepth sensing pixel and the image sensing array. In some embodiments, asingle shared readout circuit is located in the image sensing array. Insome embodiments, portions of a shared readout circuit are located ineach of the depth sensing pixel and the image sensing array.

FIG. 11 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments. The positionalarrangement in FIG. 11 includes a 16:1 ratio of image sensing pixels todepth sensing pixels. The schematic diagram of the composite pixel imagesensor is the same as composite pixel image sensor 500 (FIG. 5). Incomparison with composite pixel image sensor 500, the image sensingarray of FIG. 11 includes an 8×2 array of image sensing pixels. In theembodiment of FIG. 11, a single shared readout circuit is located in thedepth sensing pixel. In some embodiments, separate readout circuits arelocated in the depth sensing pixel and the image sensing array. In someembodiments, a single shared readout circuit is located in the imagesensing array. In some embodiments, portions of a shared readout circuitare located in each of the depth sensing pixel and the image sensingarray.

FIG. 12 is a combination view of a schematic diagram of a compositepixel image sensor and a positional arrangement of the composite pixelimage sensor in accordance with some embodiments. The positionalarrangement in FIG. 12 includes an 8:1 ratio of image sensing pixels todepth sensing pixels. Groupings of the image sensing pixels in FIG. 12are arranged in a staggered pattern. In some embodiments, the staggeredpattern is called a subway tile pattern. The schematic diagram of thecomposite pixel image sensor is similar to composite pixel image sensor500 (FIG. 5). In comparison with composite pixel image sensor 500, theimage sensing array of FIG. 12 includes an 8×2 array of image sensingpixels. In the embodiment of FIG. 12, a single shared readout circuit islocated in the depth sensing pixel. In some embodiments, separatereadout circuits are located in the depth sensing pixel and the imagesensing array. In some embodiments, a single shared readout circuit islocated in the image sensing array. In some embodiments, portions of ashared readout circuit are located in each of the depth sensing pixeland the image sensing array.

The positional arrangements of FIGS. 10-12 include rectangular patternsof image sensing pixels. In some embodiments, other patterns or patternshapes are used to group the image sensing pixels with a correspondingdepth sensing pixel.

FIG. 13 is a schematic diagram of a composite pixel image sensor 1300 inaccordance with some embodiments. Composite pixel image sensor 1300includes a plurality of image sensing arrays 1310 a, 1310 b, 1310 c and1310 d. Image sensing arrays 1310 a, 1310 b, 1310 c and 1310 d arearranged in a planar fashion. A depth sensing pixel 1320 is bonded to asurface of image sensing arrays 1310 a, 1310 b, 1310 c and 1310 dopposite a side of the image sensing arrays configured to receiveincident electromagnetic radiation. Depth sensing pixel 1320 is bondedto image sensing arrays 1310 a, 1310 b, 1310 c and 1310 d at bondinginterface 1330.

Each image sensing array 1310 a, 1310 b, 1310 c and 1310 d is the sameas image sensing array 410 (FIG. 4). Each image sensing array 1310 a,1310 b, 1310 c and 1310 d includes a 2×2 array of image sensing pixels.In some embodiments, at least one image sensing array 1310 a, 1310 b,1310 c or 1310 d includes an array size other than 2×2. In someembodiments, at least one image sensing array 1310 a, 1310 b, 1310 c or1310 d is arranged in a Bayer filter arrangement. Each image sensingarray 1310 a, 1310 b, 1310 c and 1310 d includes a readout circuit,e.g., readout circuit 1315 a and readout circuit 1315 c. Readoutcircuits of a column of image sensing arrays, e.g., image sensing arrays1310 a and 1310 b, are coupled to a single readout line 1340.

Depth sensing pixel 1320 is to the same as depth sensing pixel 100 (FIG.1). Depth sensing pixel 1320 includes a readout circuit 1325. Readoutcircuit 1325 is coupled to readout line 1340.

Bonding interface 1330 includes connections 1335 which couple a portionof readout line 1340 in the image sensing arrays 1310 a, 1310 b, 1310 cand 1310 d to a portion of the readout line in depth sensing pixel 1320.Bonding interface 1330 includes a hybrid bond.

In operation, in some embodiments, each image sensor array 1310 a, 1310b, 1310 c and 1310 d receive a portion of incident electromagneticradiation and converts the received electromagnetic radiation into anelectrical charge. Depth sensing pixel 1320 also receives a portion ofthe incident electromagnetic radiation and converts the recitedelectromagnetic radiation into an electrical charge. The electricalcharges of each image sensing array, e.g., image sensing array 1310 aand image sensing array 1310 b, coupled to readout line 1340 aresequentially read out to external circuits. Depth sensing pixel 1320coupled to readout line 1340 is also read out sequentially with imagesensing arrays coupled to the readout line.

In comparison with composite pixel image sensor 400, composite pixelimage sensor 1300 reduces a number of external circuits used to processsignals read out from the image sensing arrays and the depth sensingpixel. In addition, composite pixel image sensor 1300 multiplexes thereadout signal in a time domain. In comparison, composite pixel imagesensor 400 does not multiplex the readout signals in a time domain.

FIG. 14 is a schematic diagram of a composite pixel image sensor 1400 inaccordance with some embodiments. Composite pixel image sensor 1400includes a plurality of image sensing arrays 1410 a, 1410 b, 1410 c and1410 d. Image sensing arrays 1410 a, 1410 b, 1410 c and 1410 d arearranged in a planar fashion. A depth sensing pixel 1420 is bonded to asurface of image sensing arrays 1410 a, 1410 b, 1410 c and 1410 dopposite a side of the image sensing arrays configured to receiveincident electromagnetic radiation. Depth sensing pixel 1420 is bondedto image sensing arrays 1410 a, 1410 b, 1410 c and 1410 d at bondinginterface 1430.

Each image sensing array 1410 a, 1410 b, 1410 c and 1410 d is to thesame as image sensing array 410 (FIG. 4). Each image sensing array 1410a, 1410 b, 1410 c and 1410 d includes a 2×2 array of image sensingpixels. In some embodiments, at least one image sensing array 1410 a,1410 b, 1410 c or 1410 d includes an array size other than 2x2. In someembodiments, at least one image sensing array 1410 a, 1410 b, 1410 c or1410 d is arranged in a Bayer filter arrangement. Each image sensingarray 1410 a, 1410 b, 1410 c and 1410 d includes a readout circuit,e.g., readout circuit 1415 a and readout circuit 1415 c. Image sensingarrays 1410 a and 1410 b are coupled to a single readout line 1440 a.Image sensing arrays 1410 c and 1410 d are coupled to a single readoutline 1440 b.

In comparison with depth sensing pixel 1320 (FIG. 13), depth sensingpixel 1420 includes two readout circuits 1425 a and 1425 b. Readoutcircuit 1425 a is coupled to readout line 1440 a. Readout circuit 1425 bis coupled to readout line 1440 b.

Bonding interface 1430 includes connections 1435. One connection 1435couples a portion of readout line 1440 a in the image sensing arrays1410 a and 1410 b to a portion of the readout line in depth sensingpixel 1420. Another connection 1435 couples a portion of readout line1440 b in the image sensing arrays 1410 c and 1410 d to a portion of thereadout line in depth sensing pixel 1420. Bonding interface 1430includes a hybrid bond.

In operation, in some embodiments, each image sensor array 1410 a, 1410b, 1410 c and 1410 d receives a portion of incident electromagneticradiation and converts the received electromagnetic radiation into anelectrical charge. Depth sensing pixel 1420 also receives a portion ofthe incident electromagnetic radiation and converts the recitedelectromagnetic radiation into an electrical charge. The electricalcharges of image sensing array 1410 a and image sensing array 1410 b,coupled to readout line 1440 a are sequentially read out to externalcircuits. A portion of the electrical charge of depth sensing pixel 1420transferred to second photo storage diode PSD2 is read out to readoutline 1440 a out sequentially with image sensing arrays coupled to thereadout line. The electrical charges of image sensing array 1410 c andimage sensing array 1410 d, coupled to readout line 1440 b aresequentially read out to external circuits. A portion of the electricalcharge of depth sensing pixel 1420 transferred to first photo storagediode PSD1 is read out to readout line 1440 b out sequentially withimage sensing arrays coupled to the readout line.

In comparison with composite pixel image sensor 1300, composite pixelimage sensor 1400 reduces a number of depth sensing pixels which reducesan overall size of the composite pixel image sensor. Composite pixelimage sensor 1400 reduces a resolution of depth sensing pixels incomparison with composite pixel image sensor 1400.

FIG. 15 is a flow chart of a method 1500 of using a composite pixelimage sensor in accordance with some embodiments. In operation 1502, afirst spectrum of incident electromagnetic radiation is received by animage sensing array. In some embodiments, the first spectrum is includesvisible electromagnetic radiation. In some embodiments, the imagesensing array is to the same as image sensing array 410 (FIG. 4), imagesensing array 510 (FIG. 5), image sensing array 610 (FIG. 6), imagesensing array 710 (FIG. 7), image sensing array 1310 a-1310 d (FIG. 13)or image sensing array 1410 a-1410 d (FIG. 14).

The received first spectrum of electromagnetic radiation is configuredto a first electrical charge in operation 1504. In some embodiments, thereceived electromagnetic radiation is converted to the first electricalcharge using a photodiode, e.g., a pinned photodiode.

In operation 1504, a second spectrum of incident electromagneticradiation is received by at least one depth sensing pixel. The secondspectrum is different from the first spectrum. In some embodiments, thesecond spectrum is includes NIR electromagnetic radiation. In someembodiments, the depth sensing pixel is the same as depth sensing pixel100 (FIG. 1), depth sensing pixel 420 (FIG. 4), depth sensing pixel 520(FIG. 5), depth sensing pixel 620 (FIG. 6), depth sensing pixel 720(FIG. 7), depth sensing pixel 1320 (FIG. 13) or depth sensing pixel 1420(FIG. 14).

The received second spectrum of electromagnetic radiation is configuredto a second electrical charge in operation 1508. In some embodiments,the received electromagnetic radiation is converted to the secondelectrical charge using a photodiode, e.g., a pinned photodiode.

In operation 1510, the first electrical charge is transferred toexternal circuits. The first electrical charge is transferred to theexternal circuits through a readout circuit. In some embodiments, thereadout circuit is located in the image sensing array. In someembodiments, the readout circuit is located in the at least one depthsensing pixel. In some embodiments, a portion of the readout circuit islocated in the image sensing array and another portion of the readoutcircuit is located in the at least one depth sensing pixel. In someembodiments, the first electrical charge is transferred to the externalcircuits along a readout line coupled to a separate image sensing array.In some embodiments, the first electrical charge is transferred to theexternal circuit in a time multiplexed manner.

In operation 1520, the second electrical charge is transferred to theexternal circuits. In some embodiments, operation 1520 is to the same asmethod 200. The second electrical charge is transferred to the externalcircuits through a readout circuit. In some embodiments, the readoutcircuit for transferring the second electrical charge is a same readoutcircuit as that used to transfer the first electrical charge. In someembodiments, the readout circuit for transferring the second electricalcharge is different from a readout circuit used to transfer the firstelectrical charge. In some embodiments, the readout circuit is locatedin the image sensing array. In some embodiments, the readout circuit islocated in the at least one depth sensing pixel. In some embodiments, aportion of the readout circuit is located in the image sensing array andanother portion of the readout circuit is located in the at least onedepth sensing pixel. In some embodiments, the second electrical chargeis transferred to the external circuits along a readout line coupled tomultiple image sensing arrays. In some embodiments, the secondelectrical charge is transferred to the external circuits along a firstreadout line in a first readout operation and along a separate readoutline in a subsequent readout operation. In some embodiments, the secondelectrical charge is transferred to the external circuits in a timemultiplexed manner.

In some embodiments, an order of the operations of method 1500 isaltered. In some embodiments, at least one operation of method 1500 iscombined with at least another operation of the method. In someembodiments, additional operations are included in method 1500.

FIG. 16 is a flow chart of a method 1600 of making a composite pixelimage sensor in accordance with some embodiments. In operation 1602, animage sensing array is formed. In some embodiments, the image sensingarray is a front-side illuminated image sensor. In some embodiments, theimage sensing array is a back-side illuminated image sensor. In someembodiments, the image sensing array is to the same as image sensingarray 410 (FIG. 4), image sensing array 510 (FIG. 5), image sensingarray 610 (FIG. 6), image sensing array 710 (FIG. 7), image sensingarray 810 (FIG. 8), image sensing array 1310 a-1310 d (FIG. 13) or imagesensing array 1410 a-1410 d (FIG. 14).

In operation 1604, at least one depth sensing pixel is formed. In someembodiments, the depth sensing pixel is a front-side illuminated imagesensor. In some embodiments, the depth sensing pixel is a back-sideilluminated image sensor. In some embodiments, the image sensing arrayis to the same as depth sensing pixel 100 (FIG. 1), depth sensing pixel420 (FIG. 4), depth sensing pixel 520 (FIG. 5), depth sensing pixel 620(FIG. 6), depth sensing pixel 720 (FIG. 7), depth sensing pixel array820 (FIG. 8), depth sensing pixel 1320 (FIG. 13) or depth sensing pixel1420 (FIG. 14).

The image sensing array is bonded to the at least one depth sensingpixel in operation 1606. In some embodiments, the image sensing array isbonded to the at least one depth sensing pixel using a fusion bond. Insome embodiments, the image sensing array is bonded to the at least onedepth sensing pixel using a eutectic bond. In some embodiments, theimage sensing array is bonded to the at least one depth sensing pixelusing a hybrid bond.

In some embodiments, an order of the operations of method 1600 isaltered. In some embodiments, at least one operation of method 1600 iscombined with at least another operation of the method. In someembodiments, additional operations are included in method 1600.

One aspect of this description relates to a sensor. The sensor includesa plurality of image sensors, wherein each image sensor of the pluralityof image sensors is configured to detect a first spectrum of light. Thesensor further includes a depth sensing pixel bonded to each imagesensor of the plurality of image sensors, wherein the depth sensingpixel is configured to detect a second spectrum of light different fromthe first spectrum.

Another aspect of this description relates to a sensor. The sensorincludes a first plurality of image sensors, wherein each image sensorof the first plurality of image sensors is configured to detect a firstspectrum of light. The sensor further includes a first interconnectstructure electrically connected to each image sensor of the firstplurality of image sensors. The sensor further includes a first depthsensing pixel configured to detect a second spectrum of light differentfrom the first spectrum. The sensor further includes a secondinterconnect structure electrically connected to the first depth sensingpixel, wherein the first interconnect structure is bonded to the secondinterconnect structure.

Still another aspect of this description relates to a method of using asensor. The method includes receiving a first spectrum of light using animage sensing array. The method further includes converting the receivedfirst spectrum of light into a first electrical charge. The methodfurther includes receiving a second spectrum of light using a depthsensing pixel, wherein the depth sensing pixel is bonded to the imagesensing array, and the second spectrum of light is different from thefirst spectrum of light. The method further includes converting thereceived second spectrum of light into a second electrical charge. Themethod further includes outputting the first electrical charge and thesecond electrical charge.

The foregoing outlines features of several embodiments so that thoseskilled in the art may better understand the aspects of the presentdisclosure. Those skilled in the art should appreciate that they mayreadily use the present disclosure as a basis for designing or modifyingother processes and structures for carrying out the same purposes and/orachieving the same advantages of the embodiments introduced herein.Those skilled in the art should also realize that such equivalentconstructions do not depart from the spirit and scope of the presentdisclosure, and that they may make various changes, substitutions, andalterations herein without departing from the spirit and scope of thepresent disclosure.

What is claimed is:
 1. A sensor comprising: a plurality of imagesensors, wherein each image sensor of the plurality of image sensors isconfigured to detect a first spectrum of light; and a depth sensingpixel bonded to each image sensor of the plurality of image sensors,wherein the depth sensing pixel is configured to detect a secondspectrum of light different from the first spectrum.
 2. The sensor ofclaim 1, wherein a first image sensor of the plurality of image sensorsis configured to detect a first waveband in the first spectrum of light,a second image sensor of the plurality of image sensors is configured todetect a second waveband in the first spectrum of light, and the firstwaveband is different from the second waveband.
 3. The sensor of claim1, further comprising a connection at an interface between the pluralityof image sensors and the depth sensing pixel.
 4. The sensor of claim 3,further comprising a first readout circuit electrically connectedbetween at least one sensor of the plurality of sensors and theconnection.
 5. The sensor of claim 4, further comprising a secondreadout circuit electrically connected between the depth sensing pixeland the connection.
 6. The sensor of claim 3, further comprising areadout circuit, wherein the readout circuit comprises: a first portionelectrically connected between the plurality of image sensors and theconnection; and a second portion electrically connected between thedepth sensing pixel and the connection.
 7. The sensor of claim 6,wherein the first portion comprises a reset transistor.
 9. The sensor ofclaim 3, further comprising a readout circuit electrically connectedbetween at least one sensor of the plurality of sensors and theconnection.
 10. A sensor comprising: a first plurality of image sensors,wherein each image sensor of the first plurality of image sensors isconfigured to detect a first spectrum of light; a first interconnectstructure electrically connected to each image sensor of the firstplurality of image sensors; a first depth sensing pixel configured todetect a second spectrum of light different from the first spectrum; anda second interconnect structure electrically connected to the firstdepth sensing pixel, wherein the first interconnect structure is bondedto the second interconnect structure.
 11. The sensor of claim 10,further comprising a second plurality of image sensors, wherein thefirst plurality of image sensors is electrically connected between thesecond plurality of image sensors and the first depth sensing pixel. 12.The sensor of claim 10, further comprising: a second plurality of imagesensors electrically separated from the first plurality of imagesensors; and a second depth sensing pixel electrically separated fromthe first depth sensing pixel, wherein each image sensor of the secondplurality of image sensors is electrically connected to the second depthsensing pixel.
 13. The sensor of claim 10, further comprising a secondplurality of image sensors, wherein the first depth sensing pixel iselectrically connected between the second plurality of image sensors andthe first plurality of image sensors.
 14. The sensor of claim 13,further comprising a first readout circuit electrically connectedbetween the first depth sensing pixel and the first plurality of imagesensors.
 15. The sensor of claim 14, further comprising a second readoutcircuit electrically connected between the first depth sensing pixel andthe second plurality of image sensors.
 16. A method of using a sensor,the method comprising: receiving a first spectrum of light using animage sensing array; converting the received first spectrum of lightinto a first electrical charge; receiving a second spectrum of lightusing a depth sensing pixel, wherein the depth sensing pixel is bondedto the image sensing array, and the second spectrum of light isdifferent from the first spectrum of light; converting the receivedsecond spectrum of light into a second electrical charge; and outputtingthe first electrical charge and the second electrical charge.
 17. Themethod of claim 16, wherein outputting the first electrical chargecomprises outputting the first electrical charge using a first readoutcircuit, and outputting the second electrical charge comprisesoutputting the second electrical charge using the first readout circuit.18. The method of claim 16, wherein outputting the first electricalcharge comprises outputting the first electrical charge using a firstreadout circuit, and outputting the second electrical charge comprisesoutputting the second electrical charge using a second readout circuitdifferent from the first readout circuit.
 19. The method of claim 16,wherein outputting the second electrical charge comprises performing atleast one correlated double sampling.
 20. The method of claim 16,wherein the depth sensing pixel is bonded to the image sensing array atan connection, and outputting at least one of the first electricalcharge or the second electrical charge comprises transferring a signalacross the connection.